Second derivative

Short description: Mathematical operation

The second derivative of a quadratic function is constant.

In calculus, the second derivative, or the second-order derivative, of a function f is the derivative of the derivative of f. Informally, the second derivative can be phrased as "the rate of change of the rate of change"; for example, the second derivative of the position of an object with respect to time is the instantaneous acceleration of the object, or the rate at which the velocity of the object is changing with respect to time. In Leibniz notation: [math]\displaystyle{ a = \frac{dv}{dt} = \frac{d^2 x}{dt^2}, }[/math] where a is acceleration, v is velocity, t is time, x is position, and d is the instantaneous "delta" or change. The last expression [math]\displaystyle{ \tfrac{d^2 x}{dt^2} }[/math] is the second derivative of position (x) with respect to time.

On the graph of a function, the second derivative corresponds to the curvature or concavity of the graph. The graph of a function with a positive second derivative is upwardly concave, while the graph of a function with a negative second derivative curves in the opposite way.

Second derivative power rule

The power rule for the first derivative, if applied twice, will produce the second derivative power rule as follows: [math]\displaystyle{ \frac{d^2}{dx^2} x^n = \frac{d}{dx}\frac{d}{dx} x^n = \frac{d}{dx} \left(n x^{n-1}\right) = n \frac{d}{dx} x^{n-1} = n(n - 1)x^{n-2}. }[/math]

Notation

Further information: Notation for differentiation

The second derivative of a function [math]\displaystyle{ f(x) }[/math] is usually denoted [math]\displaystyle{ f''(x) }[/math]. That is: [math]\displaystyle{ f'' = \left(f'\right)' }[/math] When using Leibniz's notation for derivatives, the second derivative of a dependent variable y with respect to an independent variable x is written [math]\displaystyle{ \frac{d^2y}{dx^2}. }[/math] This notation is derived from the following formula: [math]\displaystyle{ \frac{d^2y}{dx^2} \,=\, \frac{d}{dx}\left(\frac{dy}{dx}\right). }[/math]

Example

Given the function [math]\displaystyle{ f(x) = x^3, }[/math] the derivative of f is the function [math]\displaystyle{ f'(x) = 3x^2. }[/math] The second derivative of f is the derivative of [math]\displaystyle{ f' }[/math], namely [math]\displaystyle{ f''(x) = 6x. }[/math]

Relation to the graph

A plot of [math]\displaystyle{ f(x) = \sin(2x) }[/math] from [math]\displaystyle{ -\pi/4 }[/math] to [math]\displaystyle{ 5\pi/4 }[/math]. The tangent line is blue where the curve is concave up, green where the curve is concave down, and red at the inflection points (0, [math]\displaystyle{ \pi }[/math]/2, and [math]\displaystyle{ \pi }[/math]).

Concavity

The second derivative of a function f can be used to determine the concavity of the graph of f. A function whose second derivative is positive will be concave up (also referred to as convex), meaning that the tangent line will lie below the graph of the function. Similarly, a function whose second derivative is negative will be concave down (also simply called concave), and its tangent lines will lie above the graph of the function.

Inflection points

If the second derivative of a function changes sign, the graph of the function will switch from concave down to concave up, or vice versa. A point where this occurs is called an inflection point. Assuming the second derivative is continuous, it must take a value of zero at any inflection point, although not every point where the second derivative is zero is necessarily a point of inflection.

Second derivative test

The relation between the second derivative and the graph can be used to test whether a stationary point for a function (i.e., a point where [math]\displaystyle{ f'(x) = 0 }[/math]) is a local maximum or a local minimum. Specifically,

• If [math]\displaystyle{ f''(x) \lt 0 }[/math], then [math]\displaystyle{ f }[/math] has a local maximum at [math]\displaystyle{ x }[/math].
• If [math]\displaystyle{ f''(x) \gt 0 }[/math], then [math]\displaystyle{ f }[/math] has a local minimum at [math]\displaystyle{ x }[/math].
• If [math]\displaystyle{ f''(x) = 0 }[/math], the second derivative test says nothing about the point [math]\displaystyle{ x }[/math], a possible inflection point.

The reason the second derivative produces these results can be seen by way of a real-world analogy. Consider a vehicle that at first is moving forward at a great velocity, but with a negative acceleration. Clearly, the position of the vehicle at the point where the velocity reaches zero will be the maximum distance from the starting position – after this time, the velocity will become negative and the vehicle will reverse. The same is true for the minimum, with a vehicle that at first has a very negative velocity but positive acceleration.

Limit

It is possible to write a single limit for the second derivative: [math]\displaystyle{ f''(x) = \lim_{h \to 0} \frac{f(x+h) - 2f(x) + f(x-h)}{h^2}. }[/math]

The limit is called the second symmetric derivative. Note that the second symmetric derivative may exist even when the (usual) second derivative does not.

The expression on the right can be written as a difference quotient of difference quotients: [math]\displaystyle{ \frac{f(x+h) - 2f(x) + f(x-h)}{h^2} = \frac{\dfrac{f(x+h) - f(x)}{h} - \dfrac{f(x) - f(x-h)}{h}}{h}. }[/math] This limit can be viewed as a continuous version of the second difference for sequences.

However, the existence of the above limit does not mean that the function [math]\displaystyle{ f }[/math] has a second derivative. The limit above just gives a possibility for calculating the second derivative—but does not provide a definition. A counterexample is the sign function [math]\displaystyle{ \sgn(x) }[/math], which is defined as: [math]\displaystyle{ \sgn(x) = \begin{cases} -1 & \text{if } x \lt 0, \\ 0 & \text{if } x = 0, \\ 1 & \text{if } x \gt 0. \end{cases} }[/math]

The sign function is not continuous at zero, and therefore the second derivative for [math]\displaystyle{ x = 0 }[/math] does not exist. But the above limit exists for [math]\displaystyle{ x = 0 }[/math]: [math]\displaystyle{ \begin{align} \lim_{h \to 0} \frac{\sgn(0+h) - 2\sgn(0) + \sgn(0-h)}{h^2} &= \lim_{h \to 0} \frac{\sgn(h) - 2\cdot 0 + \sgn(-h)}{h^2} \\ &= \lim_{h \to 0} \frac{\sgn(h) + (-\sgn(h))}{h^2} = \lim_{h \to 0} \frac{0}{h^2} = 0. \end{align} }[/math]

Quadratic approximation

Just as the first derivative is related to linear approximations, the second derivative is related to the best quadratic approximation for a function f. This is the quadratic function whose first and second derivatives are the same as those of f at a given point. The formula for the best quadratic approximation to a function f around the point x = a is [math]\displaystyle{ f(x) \approx f(a) + f'(a)(x-a) + \tfrac{1}{2} f''(a)(x-a)^2. }[/math] This quadratic approximation is the second-order Taylor polynomial for the function centered at x = a.

Eigenvalues and eigenvectors of the second derivative

For many combinations of boundary conditions explicit formulas for eigenvalues and eigenvectors of the second derivative can be obtained. For example, assuming [math]\displaystyle{ x \in [0,L] }[/math] and homogeneous Dirichlet boundary conditions (i.e., [math]\displaystyle{ v(0) = v(L) = 0 }[/math] where v is the eigenvector), the eigenvalues are [math]\displaystyle{ \lambda_j = -\tfrac{j^2 \pi^2}{L^2} }[/math] and the corresponding eigenvectors (also called eigenfunctions) are [math]\displaystyle{ v_j(x) = \sqrt{\tfrac{2}{L}} \sin\left(\tfrac{j \pi x}{L}\right) }[/math]. Here, [math]\displaystyle{ v''_j(x) = \lambda_j v_j(x) }[/math], for [math]\displaystyle{ j = 1,\ldots,\infty }[/math].

For other well-known cases, see Eigenvalues and eigenvectors of the second derivative.

Generalization to higher dimensions

The Hessian

The second derivative generalizes to higher dimensions through the notion of second partial derivatives. For a function f: R³ → R, these include the three second-order partials [math]\displaystyle{ \frac{\partial^2 f}{\partial x^2}, \; \frac{\partial^2 f}{\partial y^2}, \text{ and }\frac{\partial^2 f}{\partial z^2} }[/math] and the mixed partials [math]\displaystyle{ \frac{\partial^2 f}{\partial x \, \partial y}, \; \frac{\partial^2 f}{\partial x \, \partial z}, \text{ and } \frac{\partial^2 f}{\partial y \, \partial z}. }[/math]

If the function's image and domain both have a potential, then these fit together into a symmetric matrix known as the Hessian. The eigenvalues of this matrix can be used to implement a multivariable analogue of the second derivative test. (See also the second partial derivative test.)

The Laplacian

Another common generalization of the second derivative is the Laplacian. This is the differential operator [math]\displaystyle{ \nabla^2 }[/math] (or [math]\displaystyle{ \Delta }[/math]) defined by [math]\displaystyle{ \nabla^2 f = \frac{\partial^2 f}{\partial x^2} + \frac{\partial^2 f}{\partial y^2} + \frac{\partial^2 f}{\partial z^2}. }[/math] The Laplacian of a function is equal to the divergence of the gradient, and the trace of the Hessian matrix.

See also

• Chirpyness, second derivative of instantaneous phase
• Finite difference, used to approximate second derivative
• Second partial derivative test
• Symmetry of second derivatives

Further reading

Print

• Anton, Howard; Bivens, Irl; Davis, Stephen (February 2, 2005), Calculus: Early Transcendentals Single and Multivariable (8th ed.), New York: Wiley, ISBN 978-0-471-47244-5 
• Apostol, Tom M. (June 1967), Calculus, Vol. 1: One-Variable Calculus with an Introduction to Linear Algebra, 1 (2nd ed.), Wiley, ISBN 978-0-471-00005-1, https://archive.org/details/calculus01apos 
• Apostol, Tom M. (June 1969), Calculus, Vol. 2: Multi-Variable Calculus and Linear Algebra with Applications, 1 (2nd ed.), Wiley, ISBN 978-0-471-00007-5, https://archive.org/details/calculus01apos 
• Eves, Howard (January 2, 1990), An Introduction to the History of Mathematics (6th ed.), Brooks Cole, ISBN 978-0-03-029558-4 
• Larson, Ron; Hostetler, Robert P.; Edwards, Bruce H. (February 28, 2006), Calculus: Early Transcendental Functions (4th ed.), Houghton Mifflin Company, ISBN 978-0-618-60624-5 
• Spivak, Michael (September 1994), Calculus (3rd ed.), Publish or Perish, ISBN 978-0-914098-89-8 
• Stewart, James (December 24, 2002), Calculus (5th ed.), Brooks Cole, ISBN 978-0-534-39339-7, https://archive.org/details/calculus0000stew 
• Thompson, Silvanus P. (September 8, 1998), Calculus Made Easy (Revised, Updated, Expanded ed.), New York: St. Martin's Press, ISBN 978-0-312-18548-0 

Online books

• Crowell, Benjamin (2003), Calculus, http://www.lightandmatter.com/calc/ 
• Garrett, Paul (2004), Notes on First-Year Calculus, http://www.math.umn.edu/~garrett/calculus/ 
• Hussain, Faraz (2006), Understanding Calculus, http://www.understandingcalculus.com/ 
• Keisler, H. Jerome (2000), Elementary Calculus: An Approach Using Infinitesimals, http://www.math.wisc.edu/~keisler/calc.html 
• Mauch, Sean (2004), Unabridged Version of Sean's Applied Math Book, http://www.its.caltech.edu/~sean/book/unabridged.html 
• Sloughter, Dan (2000), Difference Equations to Differential Equations, http://synechism.org/drupal/de2de/ 
• Strang, Gilbert (1991), Calculus, http://ocw.mit.edu/ans7870/resources/Strang/strangtext.htm 
• Stroyan, Keith D. (1997), A Brief Introduction to Infinitesimal Calculus, http://www.math.uiowa.edu/~stroyan/InfsmlCalculus/InfsmlCalc.htm 
• Wikibooks, Calculus, http://en.wikibooks.org/wiki/Calculus 

External links

• Discrete Second Derivative from Unevenly Spaced Points